Towards a validated glossary of usability attributes for the evaluation of wearable robotic devices.

BACKGROUND: Despite technical advances in the field of wearable robotic devices (WRD), there is still limited user acceptance of these technologies. While usability often comes as a key factor influencing acceptance, there is a scattered landscape of definitions and scopes for the term. To advance usability evaluation, and to integrate usability features as design requirements during technology development, there is a need for benchmarks and shared terminology. These should be easily accessible and implementable by developers. METHODS: An initial set of usability attributes (UA) was extracted from a literature survey on usability evaluation in WRD. The initial set of attributes was enriched and locally validated with seven developers of WRD through an online survey and a focus group. The locally validated glossary was then externally validated through a globally distributed online survey. RESULTS: The result is the Robotics Usability Glossary (RUG), a comprehensive glossary of 41 UA validated by 70 WRD developers from 17 countries, ensuring its generalizability. 31 of the UA had high agreement scores among respondents and 27 were considered highly relevant in the field, but only 11 of them had been included as design criteria by the respondents. CONCLUSIONS: Multiple UA ought to be considered for a comprehensive usability assessment. Usability remains inadequately incorporated into device development, indicating a need for increased awareness and end-user perspective. The RUG can be readily accessed through an online platform, the Interactive Usability Toolbox (IUT), developed to provide context-specific outcome measures and usability evaluation methods. Overall, this effort is an important step towards improving and promoting usability evaluation practices within WRD. It has the potential to pave the way for establishing usability evaluation benchmarks that further endorse the acceptance of WRD.

Mixed methods usability evaluation of an assistive wearable robotic hand orthosis for people with spinal cord injury.

BACKGROUND: Robotic hand orthoses (RHO) aim to provide grasp assistance for people with sensorimotor hand impairment during daily tasks. Many of such devices have been shown to bring a functional benefit to the user. However, assessing functional benefit is not sufficient to evaluate the usability of such technologies for daily life application. A comprehensive and structured evaluation of device usability not only focusing on effectiveness but also efficiency and satisfaction is required, yet often falls short in existing literature. Mixed methods evaluations, i.e., assessing a combination of quantitative and qualitative measures, allow to obtain a more holistic picture of all relevant aspects of device usability. Considering these aspects already in early development stages allows to identify design issues and generate generalizable benchmarks for future developments. METHODS: We evaluated the short-term usability of the RELab tenoexo, a RHO for hand function assistance, in 15 users with tetraplegia after a spinal cord injury through a comprehensive mixed methods approach. We collected quantitative data using the Action Research Arm Test (ARAT), the System Usability Scale (SUS), and timed tasks such as the donning process. In addition, qualitative data were collected through semi-structured interviews and user observations, and analyzed with a thematic analysis to enhance the usability evaluation. All insights were attributed and discussed in relation to specifically defined usability attributes such as comfort, ease of use, functional benefit, and safety. RESULTS: The RELab tenoexo provided an immediate functional benefit to the users, resulting in a mean improvement of the ARAT score by 5.8 points and peaking at 15 points improvement for one user (clinically important difference: 5.7 points). The mean SUS rating of 60.6 represents an adequate usability, however, indicating that especially the RHO donning (average task time = 295 s) was perceived as too long and cumbersome. The participants were generally very satisfied with the ergonomics (size, dimensions, fit) of the RHO. Enhancing the ease of use, specifically in donning, increasing the provided grasping force, as well as the availability of tailoring options and customization were identified as main improvement areas to promote RHO usability. CONCLUSION: The short-term usability of the RELab tenoexo was thoroughly evaluated with a mixed methods approach, which generated valuable data to improve the RHO in future iterations. In addition, learnings that might be transferable to the evaluation and design of other RHO were generated, which have the potential to increase the daily life applicability and acceptance of similar technologies.

Design and validation of a novel online platform to support the usability evaluation of wearable robotic devices.

Wearable robotic devices (WRD) are still struggling to fulfill their vast potential. Inadequate daily life usability is one of the main hindrances to increased technology acceptance. Improving usability evaluation practices during the development of WRD could help address these limitations. In this work, we present the design and validation of a novel online platform aiming to fill this gap, the Interactive Usability Toolbox (IUT). This platform consists of a public website that offers an interactive, context-specific search within a database of 154 user research methods and educational information about usability. In a dedicated study, the effect of this platform to support usability evaluation was investigated. Twelve WRD experts were asked to complete the task of defining usability evaluation protocols for two specific use cases. The platform was provided to support one of the use cases. The quality and composition of the proposed protocols were assessed by (i) two blinded reviewers, (ii) the participants themselves, and (iii) the study coordinators. We showed that using the IUT significantly affected the proposed evaluation focus, shifting protocols from mainly effectiveness-oriented to more user-focused studies. The protocol quality, as rated by the external reviewers, remained equivalent to those designed with conventional strategies. A mixed-method usability evaluation of the platform yielded an overall positive image, with detailed suggestions for further improvements. The IUT is expected to positively affect the evaluation and development of WRD through its educational value, the context-specific recommendations supporting ongoing benchmarking endeavors, and highlighting the value of qualitative user research.

A Novel Mixed-Method Approach to Identify Needs and Requirements for Upper Limb Assistive Technology for Persons after Stroke.

Following stroke, a significant portion of individuals suffer from upper limb impairments and struggle with activities of daily living. Dedicated assistive technology (AT), such as robotic hand orthoses (RHO), can help facilitate upper limb usage and allow users to regain independence in their daily lives. Often, users' needs and requirements are neglected in AT design, thereby contributing to poor technology acceptance. In this work, we propose and apply a mixed-method focus group combining qualitative and quantitative components to gather user expectations in view of a user-centred redesign of a RHO. Three main themes emerged from a thematic analysis of two focus groups (n=5): Experience after stroke, desired design features, and reflections and realisations. Participants listed device features they would look for in AT and ranked them relative to what they deem important and necessary for a satisfactory device. Participants primarily looked for AT that is effective, intuitive and easy to use. These insights complement traditional technical design requirements for RHO by considering user desires, aspects unfortunately often neglected in the early design process. This work provides guidelines allowing for the optimization of AT design to better match the needs of persons after stroke and improve technology acceptance.

An Analysis of Intention Detection Strategies to Control Advanced Assistive Technologies at the CYBATHLON.

With the increasing range of functionalities of advanced assistive technologies (AAT), reliable control and initiation of the desired actions become increasingly challenging for users. In this work, we present an analysis of current practices, user preferences, and usability of AAT intention detection strategies based on a survey among participants with disabilities at the CYBATHLON 2020 Global Edition. We collected data from 35 respondents, using devices in various disciplines and levels of technology maturity. We found that conventional, direct inputs such as buttons and joysticks are used by the majority of AAT (71.4%) due to their simplicity and learnability. However, 22 respondents (62.8%) reported a desire for more natural control using muscle or non-invasive brain signals, and 37.1% even reported an openness to invasive strategies for potentially improved control. The usability of the used strategies in terms of the explored attributes (reliability, mental effort, required learning) was mainly perceived positively, whereas no significant difference was observed across intention detection strategies and device types. It can be assumed that the strategies used during the CYBATHLON realistically represent options to control an AAT in a dynamic, physically and mentally demanding environment. Thus, this work underlines the need for carefully considering user needs and preferences for the selection of intention detection strategies in a context of use outside the laboratory.

A survey on the influence of CYBATHLON on the development and acceptance of advanced assistive technologies.

BACKGROUND: Advanced assistive technologies (AAT) aim to exploit the vast potential of technological developments made in the past decades to improve the quality of life of people with disabilities. Combining complex robotic technologies with the unique needs of people with disabilities requires a strong focus on user-centered design to ensure that the AAT appropriately addresses the daily life struggles of target users. The CYBATHLON aims to promote this mindset by empowering the AAT target users ("pilots") to compete on race tracks that represent approximations of daily life obstacles. The objective of this work was to investigate the AAT technology development, usability, and user involvement (i.e., application of user-centered design) in the context of the CYBATHLON. METHODS: With an online survey targeting the pilots and technical leads of teams preparing for the CYBATHLON 2020 Global Edition, we investigated to what extent the pilots were involved in device development and how this influences the perceived usability of the showcased AAT. Furthermore, the effects of user-centered design variables on the individual race performances were analyzed. RESULTS: A total of 81 responses from 35 pilots and 46 technical leads were collected in the two weeks prior to the event. Of all teams partaking in the included disciplines of the CYBATHLON 2020 Global Edition, 81.8% (36 of 44) were included in the study. User-centered design appeared to be a prevalent practice among the teams, as 85.7% of all pilots reported a certain level of involvement. However, only 25.5% of the pilots reported daily life usage, despite QUEST usability scores of both respondent groups showing moderate to high satisfaction with the respected AAT across all investigated disciplines. An explorative linear mixed model indicated that daily life usage (p < 0.05) and prolonged user involvement (e.g., more than 2 years, p < 0.001) have a significant positive effect on the race performance at the competition. CONCLUSIONS: We conclude that the CYBATHLON positively fulfills its conceptual goals of promoting active participation and inclusion of people with disabilities in the design and evaluation of AAT, thereby stimulating the development of promising novel technological solutions. Also, our data could underline the value of the competition as a benchmark, highlighting remaining usability limitations or technology adoption hurdles.

Implementing an interprofessional user-centered design approach to develop a bedside leg exercise device.

BACKGROUND: Early mobilization is important to improve critically ill patients' outcomes, but barriers to its implementation are common. A suitable in-bed device to exercise patients' legs might facilitate early mobilization. OBJECTIVE: The aim of this study was to develop an in-bed leg press that would facilitate early mobilization and enhance strength training of patients in acute care settings. METHODS: A user-centered design approach was applied to develop the device. The process was assessed by different instruments: the system usability scale (SUS) questionnaire, the Kano model questionnaire and interviews with end-users. RESULTS: Through several iterations of a user-centered design process, the prototype of an in-bed leg press was developed and tested. The assessment, based on SUS, Kano and interviews, indicates high usability and demonstrates the advantages of a user-centered design process. CONCLUSIONS: An interprofessional user-centered design approach was successfully implemented to develop a medical device. The early involvement of end-users resulted in a design that already shows a high degree of production readiness. The resulting device fulfilled all core requirements from a therapeutic point of view and included key features related to its practical use.

User-centered Design and Evaluation of Physical Interfaces for an Exoskeleton for Paraplegic Users.

Over the last decade, the use of wearable exoskeletons for human locomotion assistance has become more feasible. The VariLeg powered lower limb robotic exoskeleton is an example of such systems, potentially enabling paraplegic users to perform upright activities of daily living. The acceptance of this type of robotic assistive technologies is often still affected by limited usability, in particular regarding the physical interface between the exoskeleton and the user (here referred to as pilot). In this study, we proposed and evaluated a novel pilot attachment system (PAS), which was designed based on user-centered design with experienced paraplegic exoskeleton users. Subjective assessments to compare usability aspects of the initial and the redesigned physical interfaces were conducted with two paraplegic and five healthy pilots. The redesigned PAS showed a 45% increase in the system usability scale (SUS), normalized to the PAS of a commercial exoskeleton assessed in the same manner. Pain rating scales assessed with healthy pilots indicated an increased comfort using the redesigned PAS while performing several activities of daily living. Overall, an improvement in usability relative to the initial PAS was achieved through intensified user evaluation and individual needs assessments. Hence, a user-centered design of physical body-machine interfaces has the potential to positively influence the usability and acceptance of lower limb exoskeletons for paraplegic users.

Assisting hand function after spinal cord injury with a fabric-based soft robotic glove.

BACKGROUND: Spinal cord injury is a devastating condition that can dramatically impact hand motor function. Passive and active assistive devices are becoming more commonly used to enhance lost hand strength and dexterity. Soft robotics is an emerging discipline that combines the classical principles of robotics with soft materials and could provide a new class of active assistive devices. Soft robotic assistive devices enable a human-robot interaction facilitated by compliant and light-weight structures. The scope of this work was to demonstrate that a fabric-based soft robotic glove can effectively assist participants affected by spinal cord injury in manipulating objects encountered in daily living. METHODS: The Toronto Rehabilitation Institute Hand Function Test was administered to 9 participants with C4-C7 spinal cord injuries to assess the functionality of the soft robotic glove. The test included object manipulation tasks commonly encountered during activities of daily living (ADL) and lift force measurements. The test was administered to each participant twice; once without the assistive glove to provide baseline data and once while wearing the assistive glove. The object manipulation subtests were evaluated using a linear mixed model, including interaction effects of variables such as time since injury. The lift force measures were separately evaluated using the Wilcoxon signed-rank test. RESULTS: The soft robotic glove improved object manipulation in ADL tasks. The difference in mean scores between baseline and assisted conditions was significant across all participants and for all manipulated objects. An improvement of 33.42 ± 15.43% relative to the maximal test score indicates that the glove sufficiently enhances hand function during ADL tasks. Moreover, lift force also increased when using the assistive soft robotic glove, further demonstrating the effectiveness of the device in assisting hand function. CONCLUSIONS: The results gathered in this study validate our fabric-based soft robotic glove as an effective device to assist hand function in individuals who have suffered upper limb paralysis following a spinal cord injury.